Multivariate Statistical Approach for Anomaly Detection and Lost Data Recovery in Wireless Sensor Networks

Data loss due to integrity attacks or malfunction constitutes a principal concern in wireless sensor networks (WSNs). The present paper introduces a novel data loss/modification detection and recovery scheme in this context. Both elements, detection and data recovery, rely on a multivariate statistical analysis approach that exploits spatial density, a common feature in network environments such as WSNs. To evaluate the proposal, we consider WSN scenarios based on temperature sensors, both simulated and real. Furthermore, we consider three different routing algorithms, showing the strong interplay among (a) the routing strategy, (b) the negative effect of data loss on the network performance, and (c) the data recovering capability of the approach. We also introduce a novel data arrangement method to exploit the spatial correlation among the sensors in a more efficient manner. In this data arrangement, we only consider the nearest nodes to a given affected sensor, improving the data recovery performance up to 99%. According to the results, the proposed mechanisms based on multivariate techniques improve the robustness of WSNs against data loss.This work has been partially supported by Spanish MICINN (Ministerio de Ciencia e Innovación) through Project TEC2011-22579, by Spanish MINECO (Ministerio de Economía y Competitividad) through Project TIN2014-60346-R, and the FPU P6A grants program of the University of Granada

Multivariate statistical process control based on principal component analysis: implementation of framework in R

The interest in multivariate statistical process control (MSPC) has increased as the industrial processes have become more complex. This paper presents an industrial process involving a plastic part in which, due to the number of correlated variables, the inversion of the covariance matrix becomes impossible, and the classical MSPC cannot be used to identify physical aspects that explain the causes of variation or to increase the knowledge about the process behaviour. In order to solve this problem, a Multivariate Statistical Process Control based on Principal Component Analysis (MSPC-PCA) approach was used and an R code was developed to implement it according some commercial software used for this purpose, namely the ProMV (c) 2016 from ProSensus, Inc. (www.prosensus.ca). Based on used dataset, it was possible to illustrate the principles of MSPC-PCA. This work intends to illustrate the implementation of MSPC-PCA in R step by step, to help the user community of R to be able to perform it.FCT - Fundação para a Ciência e a Tecnologia(UID/CEC/00319/2013

A Comparative Study of Different Methodologies for Fault Diagnosis in Multivariate Quality Control

Different methodologies for fault diagnosis in multivariate quality control have been proposed in recent years. These methods work in the space of the original measured variables and have performed reasonably well when there is a reduced number of mildly correlated quality and/or process variables with a well-conditioned covariance matrix. These approaches have been introduced by emphasizing their positive or negative virtues, generally on an individual basis, so it is not clear for the practitioner the best method to be used. This paper provides a comprehensive study of the performance of diverse methodological approaches when tested on a large number of distinct simulated scenarios. Our primary aim is to highlight key weaknesses and strengths in these methods as well as clarifying their relationships and the requirements for their implementation in practice.Vidal Puig, S.; Ferrer, A. (2014). A Comparative Study of Different Methodologies for Fault Diagnosis in Multivariate Quality Control. Communications in Statistics - Simulation and Computation. 43(5):986-1005. doi:10.1080/03610918.2012.720745S9861005435Arteaga, F., & Ferrer, A. (2010). How to simulate normal data sets with the desired correlation structure. Chemometrics and Intelligent Laboratory Systems, 101(1), 38-42. doi:10.1016/j.chemolab.2009.12.003Doganaksoy, N., Faltin, F. W., & Tucker, W. T. (1991). Identification of out of control quality characteristics in a multivariate manufacturing environment. Communications in Statistics - Theory and Methods, 20(9), 2775-2790. doi:10.1080/03610929108830667Fuchs, C., & Benjamini, Y. (1994). Multivariate Profile Charts for Statistical Process Control. Technometrics, 36(2), 182-195. doi:10.1080/00401706.1994.10485765Hawkins, D. M. (1991). Multivariate Quality Control Based on Regression-Adiusted Variables. Technometrics, 33(1), 61-75. doi:10.1080/00401706.1991.10484770Editorial Board. (2007). Computational Statistics & Data Analysis, 51(8), iii-v. doi:10.1016/s0167-9473(07)00125-9Hayter, A. J., & Tsui, K.-L. (1994). Identification and Quantification in Multivariate Quality Control Problems. Journal of Quality Technology, 26(3), 197-208. doi:10.1080/00224065.1994.11979526HOCHBERG, Y. (1988). A sharper Bonferroni procedure for multiple tests of significance. Biometrika, 75(4), 800-802. doi:10.1093/biomet/75.4.800HOMMEL, G. (1988). A stagewise rejective multiple test procedure based on a modified Bonferroni test. Biometrika, 75(2), 383-386. doi:10.1093/biomet/75.2.383Kourti, T., & MacGregor, J. F. (1996). Multivariate SPC Methods for Process and Product Monitoring. Journal of Quality Technology, 28(4), 409-428. doi:10.1080/00224065.1996.11979699Li, J., Jin, J., & Shi, J. (2008). Causation-BasedT2Decomposition for Multivariate Process Monitoring and Diagnosis. Journal of Quality Technology, 40(1), 46-58. doi:10.1080/00224065.2008.11917712Mason, R. L., Tracy, N. D., & Young, J. C. (1995). Decomposition ofT2 for Multivariate Control Chart Interpretation. Journal of Quality Technology, 27(2), 99-108. doi:10.1080/00224065.1995.11979573Mason, R. L., Tracy, N. D., & Young, J. C. (1997). A Practical Approach for Interpreting Multivariate T2 Control Chart Signals. Journal of Quality Technology, 29(4), 396-406. doi:10.1080/00224065.1997.11979791Murphy, B. J. (1987). Selecting Out of Control Variables With the T 2 Multivariate Quality Control Procedure. The Statistician, 36(5), 571. doi:10.2307/2348668Rencher, A. C. (1993). The Contribution of Individual Variables to Hotelling’s T 2 , Wilks’ Λ, and R 2. Biometrics, 49(2), 479. doi:10.2307/2532560Roy, J. (1958). Step-Down Procedure in Multivariate Analysis. The Annals of Mathematical Statistics, 29(4), 1177-1187. doi:10.1214/aoms/1177706449Runger, G. C., Alt, F. B., & Montgomery, D. C. (1996). Contributors to a multivariate statistical process control chart signal. Communications in Statistics - Theory and Methods, 25(10), 2203-2213. doi:10.1080/03610929608831832Sankoh, A. J., Huque, M. F., & Dubey, S. D. (1997). Some comments on frequently used multiple endpoint adjustment methods in clinical trials. Statistics in Medicine, 16(22), 2529-2542. doi:10.1002/(sici)1097-0258(19971130)16:223.0.co;2-jTukey, J. W., Ciminera, J. L., & Heyse, J. F. (1985). Testing the Statistical Certainty of a Response to Increasing Doses of a Drug. Biometrics, 41(1), 295. doi:10.2307/253066

Virtual screening, SAR and discovery of 5-(indole-3-yl)-2-[(2-nitrophenyl)amino] [1,3,4]-oxadiazole as a novel Bcl-2 inhibitor

A new series of oxadiazoles were designed to act as inhibitors of the anti-apoptotic Bcl-2 protein. Virtual screening led to the discovery of new hits that interact with Bcl-2 at the BH3 binding pocket. Further study of the structure-activity relationship of the most active compound of the first series, compound 1, led to the discovery of a novel oxadiazole analogue, compound 16j, that was a more potent small molecule inhibitor of Bcl-2. 16j had good in vitro inhibitory activity with sub-micromolar IC50 values in a metastatic human breast cancer cell line (MDA-MB-231) and a human cervical cancer cell line (HeLa). The antitumour effect of 16j is concomitant with its ability to bind to Bcl-2 protein as shown by an enzyme linked immunosorbent assay (IC50 = 4.27 μM). Compound 16j has a great potential to develop into highly active anticancer agent

Visual Analysis of a Cold Rolling Process Using Data-Based Modeling

International Conference on Engineering Applications of Neural Networks (13th. 2012. Coventry Univ, Otaniemi, Finland

An empirical approach towards the efficient and optimal production of influenza-neutralizing ovine polyclonal antibodies demonstrates that the novel adjuvant CoVaccine HT(TM) is functionally superior to Freund's adjuvant

Passive immunotherapies utilising polyclonal antibodies could have a valuable role in preventing and treating infectious diseases such as influenza, particularly in pandemic situations but also in immunocompromised populations such as the elderly, the chronically immunosuppressed, pregnant women, infants and those with chronic diseases. The aim of this study was to optimise current methods used to generate ovine polyclonal antibodies. Polyclonal antibodies to baculovirus-expressed recombinant influenza haemagglutinin from A/Puerto Rico/8/1934 H1N1 (PR8) were elicited in sheep using various immunisation regimens designed to investigate the priming immunisation route, adjuvant formulation, sheep age, and antigen dose, and to empirically ascertain which combination maximised antibody output. The novel adjuvant CoVaccine HT™ was compared to Freund’s adjuvant which is currently the adjuvant of choice for commercial production of ovine polyclonal Fab therapies. CoVaccine HT™ induced significantly higher titres of functional ovine anti-haemagglutinin IgG than Freund’s adjuvant but with fewer side effects, including reduced site reactions. Polyclonal hyperimmune sheep sera effectively neutralised influenza virus in vitro and, when given before or after influenza virus challenge, prevented the death of infected mice. Neither the age of the sheep nor the route of antigen administration appeared to influence antibody titre. Moreover, reducing the administrated dose of haemagglutinin antigen minimally affected antibody titre. Together, these results suggest a cost effective way of producing high and sustained yields of functional ovine polyclonal antibodies specifically for the prevention and treatment of globally significant diseases.Natalie E. Stevens, Cara K. Fraser, Mohammed Alsharifi, Michael P. Brown, Kerrilyn R. Diener, John D. Haybal

Latent Structures based-Multivariate Statistical Process Control: a paradigm shift

The basic fundamentals of statistical process control (SPC) were proposed by Walter Shewhart for data-starved production environments typical in the 1920s and 1930s. In the 21st century, the traditional scarcity of data has given way to a data-rich environment typical of highly automated and computerized modern processes. These data often exhibit high correlation, rank deficiency, low signal-to-noise ratio, multistage and multiway structures, and missing values. Conventional univariate and multivariate SPC techniques are not suitable in these environments. This article discusses the paradigm shift to which those working in the quality improvement field should pay keen attention. We advocate the use of latent structure based multivariate statistical process control methods as efficient quality improvement tools in these massive data contexts. This is a strategic issue for industrial success in the tremendously competitive global market.This research work was partially supported by the Spanish Ministry of Economy and Competitiveness under the project DPI2011-28112-C04-02.Ferrer, A. (2014). Latent Structures based-Multivariate Statistical Process Control: a paradigm shift. Quality Engineering. 26(1):72-91. https://doi.org/10.1080/08982112.2013.846093S7291261Aparisi, F., Jabaioyes, J., & Carrion, A. (1999). Statistical properties of the lsi multivariate control chart. Communications in Statistics - Theory and Methods, 28(11), 2671-2686. doi:10.1080/03610929908832445Arteaga, F., & Ferrer, A. (2002). Dealing with missing data in MSPC: several methods, different interpretations, some examples. Journal of Chemometrics, 16(8-10), 408-418. doi:10.1002/cem.750Bersimis, S., Psarakis, S., & Panaretos, J. (2007). Multivariate statistical process control charts: an overview. Quality and Reliability Engineering International, 23(5), 517-543. doi:10.1002/qre.829Bharati, M. H., & MacGregor, J. F. (1998). Multivariate Image Analysis for Real-Time Process Monitoring and Control. Industrial & Engineering Chemistry Research, 37(12), 4715-4724. doi:10.1021/ie980334lBharati, M. H., MacGregor, J. F., & Tropper, W. (2003). Softwood Lumber Grading through On-line Multivariate Image Analysis Techniques. Industrial & Engineering Chemistry Research, 42(21), 5345-5353. doi:10.1021/ie0210560Bisgaard, S. (2012). The Future of Quality Technology: From a Manufacturing to a Knowledge Economy & From Defects to Innovations. Quality Engineering, 24(1), 30-36. doi:10.1080/08982112.2011.627010Box, G. E. P. (1954). Some Theorems on Quadratic Forms Applied in the Study of Analysis of Variance Problems, I. Effect of Inequality of Variance in the One-Way Classification. The Annals of Mathematical Statistics, 25(2), 290-302. doi:10.1214/aoms/1177728786Camacho, J., & Ferrer, A. (2012). Cross-validation in PCA models with the element-wise k-fold (ekf) algorithm: theoretical aspects. Journal of Chemometrics, 26(7), 361-373. doi:10.1002/cem.2440Duchesne, C., Liu, J. J., & MacGregor, J. F. (2012). Multivariate image analysis in the process industries: A review. Chemometrics and Intelligent Laboratory Systems, 117, 116-128. doi:10.1016/j.chemolab.2012.04.003Efron, B., & Gong, G. (1983). A Leisurely Look at the Bootstrap, the Jackknife, and Cross-Validation. The American Statistician, 37(1), 36-48. doi:10.1080/00031305.1983.10483087Ferrer, A. (2007). Multivariate Statistical Process Control Based on Principal Component Analysis (MSPC-PCA): Some Reflections and a Case Study in an Autobody Assembly Process. Quality Engineering, 19(4), 311-325. doi:10.1080/08982110701621304Fuchs, C. (1998). Multivariate Quality Control. doi:10.1201/9781482273731Geladi, P., & Kowalski, B. R. (1986). Partial least-squares regression: a tutorial. Analytica Chimica Acta, 185, 1-17. doi:10.1016/0003-2670(86)80028-9Helland, I. S. (1988). On the structure of partial least squares regression. Communications in Statistics - Simulation and Computation, 17(2), 581-607. doi:10.1080/03610918808812681Höskuldsson, A. (1988). PLS regression methods. Journal of Chemometrics, 2(3), 211-228. doi:10.1002/cem.1180020306Hunter, J. S. (1986). The Exponentially Weighted Moving Average. Journal of Quality Technology, 18(4), 203-210. doi:10.1080/00224065.1986.11979014Edward Jackson, J. (1985). Multivariate quality control. Communications in Statistics - Theory and Methods, 14(11), 2657-2688. doi:10.1080/03610928508829069Jackson, J. E., & Mudholkar, G. S. (1979). Control Procedures for Residuals Associated With Principal Component Analysis. Technometrics, 21(3), 341-349. doi:10.1080/00401706.1979.10489779Process analysis and abnormal situation detection: from theory to practice. (2002). IEEE Control Systems, 22(5), 10-25. doi:10.1109/mcs.2002.1035214Kourti, T. (2005). Application of latent variable methods to process control and multivariate statistical process control in industry. International Journal of Adaptive Control and Signal Processing, 19(4), 213-246. doi:10.1002/acs.859Kourti, T. (2006). Process Analytical Technology Beyond Real-Time Analyzers: The Role of Multivariate Analysis. Critical Reviews in Analytical Chemistry, 36(3-4), 257-278. doi:10.1080/10408340600969957Kourti, T., & MacGregor, J. F. (1996). Multivariate SPC Methods for Process and Product Monitoring. Journal of Quality Technology, 28(4), 409-428. doi:10.1080/00224065.1996.11979699Liu, R. Y. (1995). Control Charts for Multivariate Processes. Journal of the American Statistical Association, 90(432), 1380-1387. doi:10.1080/01621459.1995.10476643Liu, R. Y., Singh, K., & Teng*, J. H. (2004). DDMA-charts: Nonparametric multivariate moving average control charts based on data depth. Allgemeines Statistisches Archiv, 88(2), 235-258. doi:10.1007/s101820400170Liu, R. Y., & Tang, J. (1996). Control Charts for Dependent and Independent Measurements Based on Bootstrap Methods. Journal of the American Statistical Association, 91(436), 1694-1700. doi:10.1080/01621459.1996.10476740LOWRY, C. A., & MONTGOMERY, D. C. (1995). A review of multivariate control charts. IIE Transactions, 27(6), 800-810. doi:10.1080/07408179508936797MacGregor, J. F. (1997). Using On-Line Process Data to Improve Quality: Challenges for Statisticians. International Statistical Review, 65(3), 309-323. doi:10.1111/j.1751-5823.1997.tb00311.xMason, R. L., Champ, C. W., Tracy, N. D., Wierda, S. J., & Young, J. C. (1997). Assessment of Multivariate Process Control Techniques. Journal of Quality Technology, 29(2), 140-143. doi:10.1080/00224065.1997.11979743Montgomery, D. C., & Woodall, W. H. (1997). A Discussion on Statistically-Based Process Monitoring and Control. Journal of Quality Technology, 29(2), 121-121. doi:10.1080/00224065.1997.11979738Nelson, P. R. C., Taylor, P. A., & MacGregor, J. F. (1996). Missing data methods in PCA and PLS: Score calculations with incomplete observations. Chemometrics and Intelligent Laboratory Systems, 35(1), 45-65. doi:10.1016/s0169-7439(96)00007-xNomikos, P., & MacGregor, J. F. (1995). Multivariate SPC Charts for Monitoring Batch Processes. Technometrics, 37(1), 41-59. doi:10.1080/00401706.1995.10485888Prats-Montalbán, J. M., de Juan, A., & Ferrer, A. (2011). Multivariate image analysis: A review with applications. Chemometrics and Intelligent Laboratory Systems, 107(1), 1-23. doi:10.1016/j.chemolab.2011.03.002Prats-Montalbán, J. M., Ferrer, A., Malo, J. L., & Gorbeña, J. (2006). A comparison of different discriminant analysis techniques in a steel industry welding process. Chemometrics and Intelligent Laboratory Systems, 80(1), 109-119. doi:10.1016/j.chemolab.2005.08.005Prats-Montalbán, J. M., & Ferrer, A. (2007). Integration of colour and textural information in multivariate image analysis: defect detection and classification issues. Journal of Chemometrics, 21(1-2), 10-23. doi:10.1002/cem.1026Bisgaard, S., Doganaksoy, N., Fisher, N., Gunter, B., Hahn, G., Keller-McNulty, S., … Wu, C. F. J. (2008). The Future of Industrial Statistics: A Panel Discussion. Technometrics, 50(2), 103-127. doi:10.1198/004017008000000136Stoumbos, Z. G., Reynolds, M. R., Ryan, T. P., & Woodall, W. H. (2000). The State of Statistical Process Control as We Proceed into the 21st Century. Journal of the American Statistical Association, 95(451), 992-998. doi:10.1080/01621459.2000.10474292Tracy, N. D., Young, J. C., & Mason, R. L. (1992). Multivariate Control Charts for Individual Observations. Journal of Quality Technology, 24(2), 88-95. doi:10.1080/00224065.1992.12015232Wierda, S. J. (1994). Multivariate statistical process control—recent results and directions for future research. Statistica Neerlandica, 48(2), 147-168. doi:10.1111/j.1467-9574.1994.tb01439.xWold, S. (1978). Cross-Validatory Estimation of the Number of Components in Factor and Principal Components Models. Technometrics, 20(4), 397-405. doi:10.1080/00401706.1978.10489693Woodall, W. H. (2000). Controversies and Contradictions in Statistical Process Control. Journal of Quality Technology, 32(4), 341-350. doi:10.1080/00224065.2000.11980013Woodall, W. H., & Montgomery, D. C. (1999). Research Issues and Ideas in Statistical Process Control. Journal of Quality Technology, 31(4), 376-386. doi:10.1080/00224065.1999.11979944Yu, H., & MacGregor, J. F. (2003). Multivariate image analysis and regression for prediction of coating content and distribution in the production of snack foods. Chemometrics and Intelligent Laboratory Systems, 67(2), 125-144. doi:10.1016/s0169-7439(03)00065-0Yu, H., MacGregor, J. F., Haarsma, G., & Bourg, W. (2003). Digital Imaging for Online Monitoring and Control of Industrial Snack Food Processes. Industrial & Engineering Chemistry Research, 42(13), 3036-3044. doi:10.1021/ie020941